Enforcing ethical goals over reinforcement-learning policies

نویسندگان

چکیده

Abstract Recent years have yielded many discussions on how to endow autonomous agents with the ability make ethical decisions, and need for explicit reasoning transparency is a persistent theme in this literature. We present modular transparent approach equip comply prescriptions, while still enacting pre-learned optimal behaviour. Our relies normative supervisor module, that integrates theorem prover defeasible deontic logic within control loop of reinforcement learning agent. The operates as both an event recorder on-the-fly compliance checker w.r.t. external norm base. successfully evaluated our several tests using variations game Pac-Man, subject variety “ethical” constraints.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

MultiQuest III Generalizing over reinforcement learning policies

The main aim of this paper is to research the possibility to share the learned reinforcement model of one agent with other agents. The main question that needs to be solved is: Can information be extracted from a local reinforcement policy that is reusable? We need to take into account how we will extract the generalizations, how many policies we will use, which of these policies are superior t...

متن کامل

Enforcing RBAC Policies over Data Stored on Untrusted Server (Extended Version)

One of the security issues in data outsourcing is the enforcement of the data owner’s access control policies. This includes some challenges. The first challenge is preserving confidentiality of data and policies. One of the existing solutions is encrypting data before outsourcing which brings new challenges; namely, the number of keys required to access authorized resources, efficient policy u...

متن کامل

Imitative Policies for Reinforcement Learning

We discuss a reinforcement learning framework where learners observe experts interacting with the environment. Our approach is to construct from these observations exploratory policies which favor selection of actions the expert has taken. This imitation strategy can be applied at any stage of learning, and requires neither that information regarding reinforcement be conveyed from the expert to...

متن کامل

Local Goals Driven Hierarchical Reinforcement Learning

Efficient exploration is of fundamental importance for autonomous agents that learn to act. Previous approaches to exploration in reinforcement learning usually address exploration in the case when the environment is fully observable. In contrast, the current paper, like the previous paper [Pch2003], studies the case when the environment is only partially observable. One additional difficulty i...

متن کامل

Reinforcement Learning with Deep Energy-Based Policies

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new algorithm, called soft Q-learning, that expresses the optimal policy via a Boltzmann distribution. We use the recently proposed amortized Stein variational gradi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Ethics and Information Technology

سال: 2022

ISSN: ['1388-1957', '1572-8439']

DOI: https://doi.org/10.1007/s10676-022-09665-8